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Claim Rejections - 35 USC § 103 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 1-4, 9, 17-20, and 25 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ubillos (US 6,486,896) in view of Sciammarella et al. (US 5,983,369). 

As per claim 1, Ubillos teaches a graphical user interface adapted to browse and retrieve 
pictures stored in a digital image; database, said graphical user interface comprising (col. 2, lines 
8-16): 

The examiner infers a database that stores a series of digital images to be a board range of 

data. 

a nletadata decoder adapted to decode metadata stored in digital image files; 

a first display level constructed with the aid of decoded metadata, said first display level 
comprising a first metaphor representing the span of time over which pictures stored in said 
database were captured (col. 2, lines 23-38) and at least a second display level constructed with 
the aid of decoded metadata and linked to said first display level (col. 2, lines 30-38). 

The examiner considers the display that is displayed once user has zoomed in to be a 
second display level. 

However, Ubillos fails to teach the interface further comprises: a plurality of first icons 
placed on said first metaphor representing predefined temporal intervals, said first icons being 
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proportionately sized to correspond to the number of pictures captured during a predefined 
temporal interval; 

The display of the second level is triggered by activating one of said first icons, said 
second display level comprising a second metaphor, and second icons placed on said second 
metaphor for grouping the pictures represented by the activated first icon, said second icons 
being proportionately sized to correspond to the number of pictures captured for each grouping. 

Sciammarella et al. teaches an interface comprises: a plurality of icons that represent 
different interval of the database, the size of the icon is corresponding to a value (col. 3, lines 13- 
19); and each icon allows user to "zoom in" for a closer examination of the data. 

It would have been obvious to an artisan at the time of the invention to include 
Sciammarella et al.'s teaching with Ubillos' interface in order to convey relevant data to the user 
visually. 

As per claim 2, Ubillos and Sciammarella teach the graphical user interface of Claim 1 . 
Ubillos further teaches the graphical user interface wherein the time intervals represented by said 
first icons correspond to years, and said second icons correspond to months, according; to 
decoded metadata (fig. 4, item 12). 

As per claim 3, Ubillos and Sciammarella teach the graphical user interface of Claim 2, 
Ubillos further teaches the graphical user interface comprising: 

at least a third display level constructed with the aid of decoded metadata, linked to said second 
display level and triggered by activating one of said second icons, said third display level 
comprising a third metaphor, and third icons placed on said third metaphor for grouping the 
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pictures represented by the activated second icon by the day of the week of capture, said third 
icons being proportionately sized to correspond to the number of pictures captured for each 
grouping (fig 4, item 21). 

The examiner infers day to be the third display level. 

As per claim 4, Ubillos and Sciammarella teach the graphical user interface of Claim 3. 
Ubillos further, teaches the graphical user interface comprising: 

at least a fourth display level constructed with the aid of decoded metadata, Hnked to said 
third display level and triggered by activating one of said third icons, said fourth display level 
comprising a fourth metaphor, and fourth icons placed on said fourth metaphor ]or grouping the 
pictures represented by the activated third icon by the time of day of capture, said fourth icons 
being proportionately sized to correspond to the number of pictures captured for each grouping 
(fig 4, item 22) 

The examiner infers hour to be the fourth display level. 

As per claim 9, Ubillos and Sciammarella teaches the graphical user interface of Claim 1. 
Ubillos further teaches the graphical user interface wherein the time intervals represented by said 
first icons correspond to decades during which pictures are captured, and said second icons 
correspond to years during which pictures are captured, according to decoded metadata (col 3, 
lines 14-16). 

As per claim 17, it is rejected with same rationale as claim 1. (see rejection above) 
As per claim 18, it is of the same scope as claim 2. (see rejection above) 
As per claim 19, it is of the same scope as claim 3 . (see rejection above) 
As per claim 20, it is of the same scope as claim 4. (see rejection above) 
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As per claim 25, it is of the same scope as claim 9. (see rejection above) 

Claims 5-8, 10-16, 21-24, and 26-32 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ubillos (US 6,486,896) in view of Sciammarella et aL(US 5,983,369) further 
in view of Patton et al.(US 6,408,301). 

As per claim 5, Ubillos and Sciammarella et al. teach the graphical user interface of 
Claim 1, wherein the time intervals represented by said first icons correspond to years. However 
they fail to teach the second icons correspond to identify events during which pictures are 
captured, according to decoded metadata. Patton et al. teaches an interface that uses icons to 
identify the series of pictures that are related to an event (col. 6, lines 5-8). It would have been 
obvious to an artisan at the time of the invention to include Patton et al.'s teaching with the 
interface of Ubillos and Sciammarella et al. in order to sort pictures in to event related group. 

As per claim 6, Ubillos, Sciammarella et al. and Patton et al. teach the graphical user 
interface of Claim 5, Ubillos further teaches wherein the display position of said second 
metaphor is substantially perpendicular to the display position of said first metaphor (fig 5b, item 
13). 

As per claim 7, Ubillos and Sciammarella et al. teach the graphical user interface of 
Claim 1, wherein the time intervals represented by said first icons correspond to years. However 
they fail to teach the second icons correspond to identify locations from which pictures are 
captured, according to decoded metadata. Patton et al. teaches an interface that uses icons to 
identify the series of pictures that are related to a location (col. 8, lines. 22-29). It would have 
been obvious to an artisan at the time of the invention to include Patton et al.'s teaching with the 
interface of Ubillos and Sciammarella et al. in order to sort pictures in to location related group. 
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As per claim 8, Ubilios and Sciammarella et aL teach the graphical user interface of 
Claim 1, wherein the time intervals represented by said first icons correspond to years. However 
they fail to teach the second icons correspond to identified people present in pictures, according 
to decoded metadata. Patton et al. teaches an interface that uses icons to identify the series of 
pictures that are related to an location (col. 6, lines 9-15). It would have been obvious to an 
artisan at the time of the invention to include Patton et al.'s teaching with the interface of Ubilios 
and Sciammarella et al. in order to sort pictures in to people related group. 

As per claim 10, Ubilios and Sciammarell et al. teach the graphical user interface of 
Claim 1 . However they fail to teach the graphical user interface further comprising an additional 
display level constructed with the aid of decoded metadata, linked to said second display level 
and triggered by activating one of said second icons, said additional display level comprising 
additional level thumbnail icons of the pictures represented by the activated second icon. Patton 
et al. teaches using thumbnail icons to present index of pictures (col 6, lines 9-21). It would have 
been obvious to an artisan at the time of the invention to include Patton et al.'s teaching with the 
interface of Ubilios and Sciammarella et al. in order to allow quick browsing through multiple 
images or pages. 

As per claim 11, Ubilios and Sciammarel et al. teach the graphical user interface of Claim 
1 , wherein the time intervals represented by said first icons correspond to years and said second 
icons correspond to months, according to decoded metadata (fig, 4, item 12). However they fail 
to teach said graphical user interface further comprising an additional display level constructed 
with the aid of decoded metadata, linked to said second display level and triggered by activating 
one of said second icons, said additional display level comprising additional level thumbnail 
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icons of the pictures represented by the activated second icon. Patton et al. teaches using 
thumbnail icons to present index of pictures (col 6, lines 9-21). It would have been obvious to an 
artisan at the time of the invention to include Patton et al.'s teaching with the interface of Ubillos 
and Sciammarella et al. in order to allow quick browsing through multiple images or pages. 

As per claim 12, Ubilios and Sciammarel et al. teach the graphical user interface of Claim 
3. However they fail to teach said interface comprising an additional display level constructed 
with the aid of decoded metadata, linked to said third display level and triggered by activating 
one of said third icons, said additional display level comprising additional level thumbnail icons 
of the pictures represented by the activated third icon. Patton et al. teaches using thumbnail 
icons to present index of pictures (col 6, lines 9-21). It would have been obvious to an artisan at 
the time of the invention to include Patton et al.'s teaching with the interface of Ubillos and 
Sciammarella et al. in order to allow quick browsing through multiple images or pages. 

As per claim 13, Ubilios and Sciammarel et al. teaches the graphical user interface of 
Claim 4. However they fail to teach said interface further comprising an additional display level 
constructed with the aid of decoded metadata, linked to said fourth display level and triggered by 
activating one of said fourth icons, said additional display level comprising additional level 
thumbnail icons of the pictures represented by the activated fourth icon. Patton et al. teaches 
using thumbnail icons to present index of pictures (col 6, lines 9-21). It would have been obvious 
to an artisan at the time of the invention to include Patton et al.'s teaching with the interface of 
Ubillos and Sciammarella et al. in order to allow quick browsing through multiple images or 
pages. 
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As per claim 14, Ubilios and Sciammarel et al. teaches the graphical user interface of 
Claim 1, wherein the time intervals represented by said first icons correspond to years. However 
they fail teach said second icons correspond to identified events during which pictures are 
captured, according to decoded metadata, said graphical user interface further comprising an 
additional display level constructed with the aid of decoded metadata, linked to said second 
display level and triggered by activating one of said second icons, said additional display level 
comprising additional display level thumbnail icons of the pictures represented by the activated 
second icon. . Patton et al. teaches an interface that uses icons to identify the series of pictures 
that are related to an event (col. 6, lines 5-8) and using thumbnail icons to present index of 
pictures (col 6, lines 9-21). It would have been obvious to an artisan at the time of the invention 
to include Patton et al.'s teaching with the interface of Ubilios and Sciammarella et al. in order to 
sort pictures in to event related group and to allow quick browsing through multiple images or 
pages. 

As per claim 15, Ubilios and Sciammarel et al. teaches the graphical user interface of 
Claim 1, wherein the time intervals represented by said first icons correspond to years. However 
they fail to teach said second icons correspond to identified locations from which pictures are 
captured, according to decoded metadata, said graphical user interface further comprising an 
additional display level constructed with the aid of decoded metadata, linked to. said second 
display level and triggered by activating one of said second icons, said additional display level 
comprising additional display level thumbnail icons of the pictures represented by the activated 
second icon. Patton et al. teaches an interface that uses icons to identify the series of pictures 
that are related to a location (col. 8, lines. 22-29) and using thumbnail icons to present index of 
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pictures (col 6, lines 9-21). It would have been obvious to an artisan at the time of the invention 
to include Patton et al.'s teaching with the interface of Ubillos and Sciammarella et al. in order to 
sort pictures in to location related group and to allow quick browsing through multiple images or 
pages. 

As per claim 16, Ubilios and Sciammarel et al. teaches the graphical user interface of 
Claim 1, wherein the time intervals represented by said first icons correspond to years. However 
they fails to teach said second icons correspond to identified people present in pictures, 
according to decoded metadata, said graphical user interface further comprising an additional 
display level linked to said second display level and triggered by activating one of said second 
icons, said additional display level comprising additional display level thumbnail icons of the 
pictures represented by the activated second icon. Patton et al. teaches an interface that uses 
icons to identify the series of pictures that are related to an location (col. 6, lines 9-15) and using 
thumbnail icons to present index of pictures (col 6, lines 9-21). It would have been obvious to an 
artisan at the time of the invention to include Patton et al.'s teaching with the interface of Ubillos 
and Sciammarella et al. in order to sort pictures in to people related group and to allow quick 
browsing through multiple images or pages. 

As per claim 21, it is of the same scope as claim 5. (see rejection above) 
As per claim 22, it is of the same scope as claim 6. (see rejection above) 
As per claim 23, it is of the same scope as claim 7. (see rejection above) 
As per claim 24, it is of the same scope. as claim 8. (see rejection above) 
As per claim 26, it is of the same scope as claim 10. (see rejection above) 
As per claim 27, it is of the same scope as claim 1 1 . (see rejection above) 
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As per claim 28, it is of the same scope as claim 12. (see rejection above) 
As per claim 29, it is of the same scope as claim 13. (see rejection above) 
As per claim 30, it is of the same scope as claim 14. (see rejection above) 
As per claim 31, it is of the same scope as claim 15. (see rejection above) 
As per claim 32, it is of the same scope as claim 16. (see rejection above) 

Conclusion 

The following patent is cited to further show the state of the art with respect to 
data indexing system: 

Shaffer et al. (US 6,396,963) : discloses a photocoUage generation and modification. 
Martino et al. (US. 6,486,898) : discloses a device and method for a lattice display. 
DeVries et al. (US 6,31 1,189) : discloses a technique for matching a query to a portion of 

media. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Peng Ke whose telephone number is (703) 305-7615. The 
examiner can normally be reached on M-F 8:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, KRISTINE L KINCAID can be reached on (703) 308-0640. The fax phone numbers 
for the organization where this application or proceeding is assigned are (703) 746-7239 for 
regular communications and (703) 746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-3900. 
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